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We present a technique to generate relations connecting pure state weights, overlaps, and cor¬ 
relation functions in short-range spin glasses. These are obtained directly from the unperturbed 
Hamiltonian and hold for general coupling distributions. All are satisfied in phases with simple 
thermodynamic structure, such as the droplet-scaling and chaotic pairs pictures. If instead nontriv¬ 
ial mixed-state pictures hold, the relations suggest that replica symmetry is broken as described by 
a Derrida-Ruelle cascade, with pure state weights distributed as a Poisson-Dirichlet process. 
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Introduction. The thermodynamic behavior in finite 
dimensions of short-range Ising spin glasses remains an 
open problem [I|. Several pictures of the thermodynam¬ 
ics of the low-temperature phase have been proposed, but 
analytical results are difhcult to obtain. In this paper we 
describe a method for generating infinite sets of identities 
in short-range spin glasses for general couplings, at any 
temperature and in any dimension. We will see that they 
are especially useful for studying nontrivial mixed-state 
pictures (including replica symmetry breaking), and we 
use them to provide strong analytical evidence that, if a 
nontrivial mixed-state picture exists in some dimension, 
then its symmetry breaking is described by a Derrida- 
Ruelle cascade • Full replica symmetry breaking cor¬ 
responds to a k-step Derrida-Ruelle cascade in the limit 
k ^ oo ii- Moreover, the pure state weights are dis¬ 
tributed as a Poisson-Dirichlet (PD) point process. (For 
a nice discussion of the PD distribution and its relation 
to various spin glass models, see Q.) Such a distribution 
of pure state weights has been proved for the generalized 
random-energy model (GREM) J3 and for certain cases 
of p-spin mean-field spin glasses [8| in restricted ranges of 
temperature. It is believed to hold as well for the canon¬ 
ical Sherrington-Kirkpatrick model though no proof 
yet exists [^. We will present the formal definition of 
the PD distribution below, but note informally here that 
it corresponds to the characterization of the free energies 
of mean-field spin glass states as independent random 
variables with an exponential distribution 0[il. 

Proposed scenarios for the spin glass phase. There 
is good experimental [l^ . and numerical [H, [Ti¬ 
ll^ evidence for a phase transition in three dimensions 
and above. Assuming, as most do (backed by numerical 
studies; see for example 0) that this is accompanied 
by broken spin-flip symmetry — equivalently, a nonzero 
Edwards-Anderson order parameter qea [3 — there are 
several possibilities for the thermodynamic structure of 
the spin glass phase. A natural framework for discussing 


this is the metastate [H [20l - lT7j| . which is an ensemble 
of thermodynamic states, of which there can in princi¬ 
ple be one or many [2^. Each of these thermodynamic 
states comprises either a single pure state or else a con¬ 
vex mixture of distinct pure states; if the latter, we refer 
to it as a mixed state. If spin-flip symmetry is present in 
the Hamiltonian and broken at some fixed inverse tem¬ 
perature /3, and if the metastate is generated through a 
sequence of finite volumes with spin-symmetric boundary 
conditions (such as periodic, antiperiodic, or free), then 
each of the thermodynamic states in the metastate must 
be mixed, giving equal weight to spin-reversed pairs of 
pure states. If each such thermodynamic state consists of 
only a single pair of spin-reversed pure states, each with 
weight 1/2, we will refer to it as a trivial mixture', a non¬ 
trivial mixture denotes a thermodynamic state compris¬ 
ing an infinite set of pairs of pure states, with the mem¬ 
bers of each pair having equal weight and the weights of 
all pure states summing to unity [29|. 

We now list the main proposed possibilities for the 
thermodynamics of short-range spin glasses, under the 
assumption of broken spin-flip symmetry. The simplest 
picture, from the viewpoint of structure and organization 
of pure states, is one that conjectures a single thermody¬ 
namic state consisting of a trivial mixture of pure states. 
This well-known picture arises from the drop let-scaling 
ansatz, and was put forward by McMillan [^, Bray and 
Moore [3l|, and Eisher and Huse This picture 

asserts that the low-temperature spin glass phase is sup¬ 
ported on a single pure state pair. 

In order of increasing complexity (again from the view¬ 
point of pure state structure and organization), the next 
picture supposes an infinite ensemble of thermodynamic 
states, but with each such state a trivial mixture. This 
is the chaotic pairs picture [I|, [2ll - [^ , and is a “many- 
state” picture (that is, the metastate is supported on an 
uncountable infinity of pure state pairs), but one in which 
the spin overlap structure is trivial, as in droplet-scaling. 
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A far more complex picture supposes an infinite ensem¬ 
ble of thermodynamic states, each of which is a nontrivial 
mixture of pure states. There are many possible scenarios 
of pure state structure and organization that are a priori 
consistent with nontrivial mixed-state pictures, but the 
most well-known is the replica symmetry breaking (RSB) 
picture due to Parisi and co-workers [35l - l37l |. This picture 
has a complicated overlap structure. 

As noted elsewhere [s^, another important sce¬ 
nario [1^, known as ‘TNT’ (trivial edge, nontrivial 
spin overlap), can be consistent with any of the above 
three (but see also [4l|). There has been a large body 
of numerical work attempting to resolve the question of 
which of these pictures (if any) describes spin glass or¬ 
dering; some of the more recent include |42h48| . 

Both the droplet-scaling and the chaotic pairs scenar¬ 
ios exhibit a relatively simple thermodynamic structure. 
The RSB picture is much more complex; the basics of its 
thermodynamic structure took a long time to be eluci¬ 
dated [I|, m, m, m, [5^ , and many of its features remain 
to be understood. Previous papers by the authors have 
presented a combination of rigorous and heuristic argu¬ 
ments that cast doubt on the internal consistency of non¬ 
trivial mixed-staty)ictures for short-range spin glasses in 
finite dimensions P, [13, (but see for a critique of 
one of these); nevertheless, in the absence of a rigorous 
argument they remain viable, and any analytical results 
on their properties are therefore useful. 

Thermodynamic states. We consider the Edwards- 
Anderson (EA) [T^ nearest-neighbor spin glass on a d- 
dimensional cubic lattice and (possibly) in a small ap¬ 
plied magnetic field. The Hamiltonian is 

^ ^ Jxy^x^y ^ ^ ^ hxCTx^ ( 1 ) 

<x,y> X 

where the couplings Jxy and fields hx are independent, 
identically distributed continuous random variables with 
mean zero and variance one, the first sum is over nearest 
neighbors only, and {JT^, /i} denotes a particular realiza¬ 
tion of the couplings and fields. If a magnetic field is 
present, e > 0; otherwise, e = 0. 

Local properties (such as correlation functions) in a 
given large volume correspond to a particular thermody¬ 
namic state, denoted by P P, [H, . Each P must be 

either a countable or continuum mixture of pure states 
(or a combination of the two). We consider here only P’s 
with a countable decomposition into pure states: 

r = (2) 

OL 

where Wa = Wa(r) is the weight of pure state pa (or 
simply a) in P. The spin overlap is defined as usual by 

= lim lAiJ^i V {ax)a{(Jx)p , (3) 

Lo^oo 

xGAlq 

where {•)ct denotes a thermal average in pure state a. 
Edge overlaps are defined similarly. We assume in what 


follows that at fixed temperature the self-overlap g““ = 
Pea of every pure state is identical |5l| . 

Thermodynamic relations. A useful tool for obtaining 
our result is the metastate, discussed in PE3“E3- The 
metastate K{j.h} can be thought of as a probability mea¬ 
sure on thermodynamic states P induced by an infinite 
sequence of volumes with specified boundary conditions. 
It contains all thermodynamic information that can be 
generated in the ensemble of all volumes. 

Our main result is the following: Eor the EA Hamilto¬ 
nian CD, consider a metastate constructed using 

coupling-independent boundary conditions, such as peri¬ 
odic. Then an infinite set of thermodynamic identities 
connecting weights, overlaps, and correlation functions, 
valid in any finite dimension and at any temperature, 
can be constructed using a well-defined procedure. These 
can be used to restrict possible scenarios of a spin glass 
phase. In this paper we use these relations to provide 
strong analytical evidence for the following conclusion: 
if the metastate is such that its P’s are supported on 
countably infinite mixtures of distinct pure states, then 
the weights of those pure states are distributed according 
to a Poisson-Dirichlet point process. 

We consider below the case e > 0 (so pure states no 
longer appear in the P’s within spin-reversed pairs of 
equal weight). As a consequence the derived relations 
involve spin rather than edge overlaps. We return briefly 
to the case of e = 0 later. We choose periodic bound¬ 
ary conditions, although the argument is equally valid 
for other choices, such as free or fixed. 

Before proceeding, we define some quantities that will 
be needed later. Let {(Jx)a be the thermal expectation of 
the spin at x in pure state a, and (crx)r = Wa{'^x)a 
be its expectation in the mixed state P. We also define 
the average overlap qr in P (for ease of notation, depen¬ 
dence on {>7,/i} is hereafter dropped): 




OC^ 


( 4 ) 


Oc0 


It follows that 


9r 


lim \Alo\ ^ 

Lq —¥00 




( 5 ) 


It is clear from m that qr is nonnegative. It also follows 
from a Cauchy-Schwartz inequality that if P comprises 
more than one pure state, then qr < qEA- 

Now for some {J,h}, and at fixed inverse tempera¬ 
ture j3 and fixed e, we choose an arbitrary site x and 
change the applied field at that site: hx ^ h'^ = 
hx + Ahx. In any P, every pure state a transforms poj| 
(see also E2“E1|) to a new pure state a', with 


1 

ra = (eyip{f5e/Ahxax)^ . 


( 6 ) 

( 7 ) 
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Then 


(1 + tanh(/3eA/i2;)(cr:j:)Q, 

Wa,, = -f , (8) 

(^1 + tanh(,deAh^)(ax}rJ 

where {ax)a, {o'x)r, and Wa are all evaluated at Ah^ = 
0. Using the notation dx = lirRAh:„^od/d{PeAhx) and 
9xx = liniA/ix^o d'^/d{l5eAhxY, we have 

dxW^ = W^({ax)o.-{(Tx)T) ( 9 ) 

and 

dxxWa = ‘2.Wa{{cJx)T “ {(^x)a{(rx)T^ ■ ( 10 ) 

Now consider a function /(T) on the states T (equiva¬ 
lently, on the correlation functions that characterize T). 
Let E[/] denote the average of / over the metastate (as 
always, for a single, fixed realization {J, h})-, that is, 

E[/] = [/] = J d«|^.,}(r) /(L). (11) 

If / is a measurable, translation-invariant function of 
both the coupling and field realizations, then by the spa¬ 
tial ergodic theorem E[/] must be the same for almost 
every {J^ h} (see, for example, H). 

To derive useful relations, one may consider many dif¬ 
ferent measurable, translation-invariant /(r)’s, each of 
which leads to different identities. Here we consider 

/(r) = liog(^iu:), ( 12 ) 

OL 

where n is any real number greater than one. By the 
above arguments, the metastate integral ^ /(r) is 

constant a.s. with respect to {J, h}. 

We now compute the second derivative with respect to 
PeAhx of the integral (ITTl) . using (IT^ as the integrand. 
Taking the limit Ahx —>■ 0 of the result, averaging over all 
sites X, and using the required constancy of the metastate 
integral of /, we find 


0 = hm ^ a..E[/(r)] 


Lq^OO 

= E 


(13) 


XeAhr, 


{n-l)qEA+ qr 

Q(/3 


where depends on T. 

As noted, (IT3l) is only one of many possible sets of ther¬ 
modynamic relations that must be satisfied by any ther¬ 
modynamic phase arising from the EA Hamiltonian P]). 
All such relations are trivially satisfied by both the 
droplet-scaling and chaotic pairs pictures: when e > 0, 
both consist of T’s (a single T in the case of droplet¬ 
scaling, many in the case of chaotic pairs) comprising 
a single pure state. The situation is very different for 


nontrivial mixed-state pictures: now the identities pro¬ 
vide strong constraints on the relations between weights, 
overlaps, and/or correlation functions. 

Rewriting m, we find 


1 — E[gr] = Jt-E 


1 - 

a,/3 


(14) 


where JqE a and similarly for qr- The RHS 

of (fTTl) must be independent of n. A similar relation was 
found for the SK model [ll|, [l^ and already rules out 
many possible distributions of the weights. 

Derrida-Ruelle cascades and Poisson-Dirichlet distri¬ 
butions. The Derrida-Ruelle cascades are the precise 
mathematical formulation of replica symmetry breaking: 
a cascade of k levels corresponds to fc-step RSB. They 
are based on Poisson point processes with exponential 
density. Consider the set {Fa, a e N), a Poisson process 
with density exp{Cx)dx. Physically, in a volume with 
spins each Fa corresponds to the 0{L~‘^) correction to 
the free energy per spin of the pure state a within a P 
taken from the metastate. For simplicity we have set the 
minimum of the Ek’s to zero. 

The set of corresponding Gibbs weights for the 

pure states at inverse temperature /3 is also Poisson with 
density {^)y~^/^~^dy on R. If Fa is Poisson with den¬ 
sity exp)^^)^^, then given that Wa = ^ 

the collection Wa is not Poisson, because of the de¬ 
pendence introduced by the normalization. The distri¬ 
bution for this collection of weights is called Poisson- 
Dirichlet with parameter A, or simply PD{X). In the 
REM, A = /3c//3 < 1 (see, for example, Q), and more 
generally it is a function of both temperature and field. 
It is not hard to see that, if Wa is PD{X), then is 
PD{X/n) for any n > 1. 

We can now compute the density of the weights on 
[0,1]. It was shown in that the density of 

states is 

ll — 77!'^ ^77 ^ ^ 

E(#{a :WaG[u,U + du]}) = ’ 

(15) 

which implies (for example) that E[^^ = 1 — A. 

1-step RSB. This is usually understood as = q {< 
qEA) for all a ^ /3. In this case gr = g + (1 - g) Y,a 
If Wa is PD(A), then E[gr] = I — A(1 — q), and 


a.,j3 


= E 




+ g-E[Epi”H”^' 


= 1 — X/n-\-qX/n, (16) 


which satisfies the consistency relations (HI for all n. 

k-step RSB. The consistency of PD distributions for 
the weights with 2-step RSB applied to (fHl) is shown in 
detail in the Supplementary Notes [l^. Here we consider 
the general fc-step case. Eq. m can be written as 

1 — y qdx{q)=n(^ — j qdx^^\q) 


(17) 
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where x{q) is the cumulative distribution func¬ 
tion (cdf) of the 2-replica spin overlap: x{q) = 
E,[J2a f3^aWp5{qai3 — (?)], and is the cdf of the 

2-replica spin overlap distribution after applying the map 
sending Wa to We can integrate (ED by parts to 
get 


f x{q) dq = n f x^’^\q) dq . (18) 

Jo Jo 


For k-step RSB, the states can be labeled by a = 
(tti ,... ,ak), with weights given by 


Wa = e ^-^“1 ■■■“»!/ e ... e ^ 

11,■■■,1k 

(19) 

where {Faj^...a^,aj G N) are independent Poisson pro¬ 
cesses with density exp{Cjx)dx and Ci < C 2 • ■ • < Ck- 

The 2-replica spin overlap distribution x{q) can then 
be written (using an argument similar to that in (53 |1 

x{q) = Ail[5i,g2) -I- A2l[q,2,53) -I-h Afcl[qj^^i)(q), (20) 

where 0 < qi < ■ ■ ■ < qi < ■ ■ ■ < qk+i = 1, 0 < Ai < 

• • • < Afe < 1, and l[a,f)) = 1 for q G [a,b) and is zero 
otherwise. 

The map Wa >—>■ induces the following map on 

x{q): 

x{q) ^ a;fo)(g) := ^l[9i.92) + ^lk2,93)-^-^“l[9fc.i)(9) ■ 

( 21 ) 

From this one recovers a linear dependence on 1/n for 
a:("-*(g). In particular, 

f x{q) dq = n f x^^\q) dq (22) 

Jo Jo 

showing that the consistency requirement imposed 
by (HI on weights and overlaps for all n is maintained 
for all k in the Derrida-Ruelle cascade if the weights are 
PD-distributed. 

We considered above the e > 0 case. The procedure for 
e = 0 is identical, with the substitutions Ahx AJ^y, 
{iXx)!! —>■ (o’xO’y)a, and with averages over sites x replaced 
by averages over edges (xy). With these transformations, 
all consistency relations are unchanged except that spin 
overlaps are replaced by edge overlaps. Consequently the 
conclusions for e > 0 carry over to e = 0. 

Discussion. We have presented a method for gener¬ 
ating consistency relations that must be satisfied in any 
finite dimension by any set of thermodynamic states on 
the spin glass metastate. An important feature of this 
method, which it shares with [55l| . is that it is not re¬ 
stricted to Gaussian couplings (any continuous distribu¬ 
tion with finite mean and variance suffices) and holds 
at any fixed temperature. Moreover, it acts directly on 
the EA Hamiltonian, as opposed to adding p-spin per¬ 
turbations to it. We have presented only relations de¬ 
rived by varying the couplings or fields up to second or¬ 
der; however, the process can be used up to derivatives 


of any order. A thermodynamic identity obtained by 
taking the n**' derivative of a translation-invariant func¬ 
tion will yield relations between weights, n-spin (or edge) 
overlaps, and/or n-spin (or edge) correlation functions. 
All such relations are trivially satisfied by simple scenar¬ 
ios like droplet-scaling or chaotic pairs (and also by the 
high-temperature paramagnetic phase), but they impose 
strong constraints on nontrivial mixed-state pictures. 

It is natural to ask whether this method provides 
an alternate means of deriving Ghirlanda-Guerra iden¬ 
tities [15 or stochastic stability relations UMM- We 
discuss this briefly in the Supplementary Notes [^, but 
summarize the main ideas here. The former contain 
nonlinearities in the form of products of metastate aver¬ 
ages, so in general Ghirlanda-Guerra identities differ from 
those presented here (except possibly for linear combina¬ 
tions of these identities that remove the nonlinear terms). 
On the other hand, the method described here can repro¬ 
duce some stochastic stability identities, but again the 
sets of identities readily derivable by the two methods 
appear to be largely distinct. 

In the above discussion we considered a particular 
function (ED- We have also checked consistency for two 
other translation-invariant, measurable functions, which 
lead to different identities, one for each n: (l/n)W/( and 
(l/n)( 7 p, where again n is any real number greater than 
one. In the first case, we checked the 1-step and 
2-step solutions for every n and in the second case the 
1-step solution for n = 2. In all cases a PD distribution 
for the weights satisfied the consistency relations. 

Of course, some choice of function could lead to an in¬ 
consistency between the resulting identities and Derrida- 
Ruelle cascades with PD distributions on the weights. 
The point of this paper is that the relations studied pro¬ 
vide evidence that the only potentially self-consistent 
nontrivial mixed-state picture is one where overlaps 
are generated via Derrida-Ruelle cascades and in which 
weights are distributed by a Poisson-Dirichlet point pro¬ 
cess. While other pictures could conceivably exist, the 
methods described here provide a powerful technique 
for testing their self-consistency: e.g., distributions on 
the weights in which the metastate average of (^q, W^) 
doesn’t scale as 1/n can already be ruled out. It is likely, 
given the number and complexity of these relations, that 
no other nontrivial mixed state pictures can exist. This 
may be provable, by studying an infinite hierarchy of 
metastate averages on products of weights raised to dif¬ 
ferent powers, and will be investigated in future work. 
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